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Background 

Prognostic indices, derived from prognostic models, can 
be used to stratify patients in clinical trials. This includes 
stratifying eligible patients for randomisation, stratifying 
randomisation, or identifying subgroups for the trial analy- 
sis. However, before an index can be used for these pur- 
poses, it needs to be validated externally in independent 
data. We demonstrate methods of external validation, 
including methods for handling a covariate missing from 
the validation dataset, via a prognostic model for risk of 
seizure recurrence following a first ever seizure. 

Methods 

Three independent datasets were obtained. External vali- 
dation was evaluated for each dataset via discrimination 
using Harrell's c-index. Calibration plots were also consid- 
ered. Five imputation methods were examined to handle a 
covariate missing from one validation dataset. These 
included hot deck imputation and multiple imputation. 
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Results 

Trial data for 620 people with epilepsy was used to 
develop the original model; the validation datasets con- 
sisted of 274, 307 and 847 trial participants respectively. 
The model generalised relatively well to the other datasets 
- two out of three calibration plots demonstrated excellent 
fits while two of the three datasets had c-indexes within 
0.01 of each other. All five methods of imputation per- 
formed fairly similarly. 

Conclusions 

Prognostic models, and consequently prognostic indices, 
can be validated by considering calibration and discrimina- 
tion methods. Although there are limitations to external 
validation, it is still a necessary part of modelling. 
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